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Digital video interface with audio and auxiliary data 



(57) One embodiment of the present invention uses 
an abbreviated blanking period, in comparison to the 
standard VESA and CEA-EIA blanking periods, in order 
to send data, including low bandwidth, non-timing infor- 
mation, over one or more channels of the digital video 
link. By shortening the blanking period, the amount of 
time available for sending data in each scan line is in- 
creased, enabling the system to send more data over 



each channel. The inactive video portion of a scan line 
sent during vertical sync may also be used to send ad- 
ditional digital data. Shortening the blanking periods 
and/or using the inactive video sections of the horizontal 
scan lines adds to the overall data capacity of the link 
and may be used to send other digital data, such as mul- 
ti-channel audio, video, control, timing, closed caption- 
ing or other digital data. 
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Description 

[0001] This application is related to, and claims benefit of and priority from Provisional Application No. 60/263,792 
filed January 24, 2001, Provisional Application No. 60/268,840 filed February 14, 2001, and Provisional Application 
5 No. 60/274,433 filed March 9, 2001, the complete subject matter of each of which is hereby incorporated herein by 
reference in its entirety. 

BACKGROUND OF THE INVENTION 

10 [0002] One embodiment of the present invention relates to increasing the amount of digital data capacity or through- 
put of a digital video link. 

[0003] Typically digital video signals have a minimum of sixty frames of video per second. Each video frame is com- 
posed of horizontal scan lines, where the number of horizontal scan lines in a frame is dependent on the resolution of 
the system. Each horizontal scan line includes a blanking period followed by a series of digital video pixels. More 
15 specifically, the horizontal blanking period is used to send timing information. This consists of an HSync : comprised of 
a Front Porch, a Synchronization Pulse and a Back Porch. There is also typically a vsync (vertical sync) blanking period 
that is comprised of a Front Porch, a Synchronization Pulse and a Back Porch. The horizontal and vertical sync blanking 
periods take up to 30 to 40% of the total bandwidth is taken up by sync data. 

[0004] Commercial applications utilizing Digital Visual Interface (hereinafter referred to as "DVI") standard frequently 
20 make significant use of existing VESA Computer Display standards. The sequence of timing and video data for particular 
display resolutions and timing is specified in the VESA Computer Display Monitor Timing standard, Version 1 .0, Revi- 
sion 0.8 dated September 1 7, 1 998, incorporated herein by reference (hereinafter referred to as "DV1 1 .0 specification"). 
A recent digital television standard is the CEA-EIA 861 standard for high-speed digital interfaces, also incorporated 
herein by reference. 

25 [0005] The DVI 1 .0 specification identifies a high-speed digital connection, interface or link for visual data types that 
are display technology independent. In one example, the interface provides a connection between a computer and its 
display device. In another example, the interface provides a connection between a set top box and a DTV or HDTV. 
Such a DVI interface enables content to remain in the lossless digital domain from creation to consumption; display 
technology independence; plug and play through hot plug detection, EDID and DDC2B; and digital and analog support 

30 in a single connector. 

[0006] One problem with commercial applications utilizing the DVI standard is that they do not provide for any trans- 
mission of digital audio data, let alone provide for the use of multiple audio channels or multiple audio streams. Another 
problem with such applications is that they do not provide for transmission of auxiliary digital data. 
[0007] Further limitations and disadvantages of conventional and traditional approaches will become apparent to 
35 one of skill in the art, through comparison of such systems with the present invention as set forth in the remainder of 
the present application with reference to the drawings. 

BRIEF SUMMARY OF THE INVENTION 

40 [0008] Aspects of the present invention may be found in a processing system for increasing the digital data capacity 
of a digital video communications link. In one embodiment the system comprises one or more assembly devices, such 
as, for example, a FIFO circuit, that assembles one or more digital data streams into a single digital data stream. The 
single digital data stream may be digital audio, for example. The system also comprises a multiplexer that is adapted 
to multiplex the single digital data stream with a line of video data to form an aggregate digital data stream. The ag- 

45 gregate digital data stream may be compatible with a predetermined video timing standard, for example. The system 
further comprises one or more transmitters that transmits the aggregate digital data stream and low bandwidth infor- 
mation. The low bandwidth information is transmitted during blanking periods associated with said aggregate digital 
data stream. 

[0009] In one embodiment, the transmitter(s) redundantly transmit the low bandwidth information. The low bandwidth 
50 information may comprise, for example, non-timing information. In the case where the single digital data stream is 
digital audio data, the low bandwidth information may be audio length information, for example. 
[0010] In another embodiment the system further comprises a receiver and a de-multiplexor. The receiver receives 
the aggregate digital data stream and the low bandwidth information, and the de-multiplexor splits out the digital data 
from the video data. This may be accomplished using the low bandwidth information. 
55 [0011] Yet another embodiment of the present invention provides a method for increasing the digital data capacity 
of a digital video communications link. The method comprises the steps of decreasing the duration of a blanking interval 
associated with a line of video data that is less than industry standard blanking intervals, combining a digital data 
stream with a line of video data, and transmitting the digital data stream and low bandwidth information. The digital 
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data stream may comprise, for example, an audio data stream, and the low bandwidth information may comprise, for 
example, audio length information or other non-timing information. The transmission of the digital data stream and the 
low bandwidth information may occur using bandwidth freed by the decrease in the duration of the blanking interval. 
In one embodiment, the low bandwidth information is redundantly transmitted. 

5 [0012] Still another embodiment of the present invention provides a method for increasing the digital data capacity 
of a digital video communications link, which comprises receiving information transmitted at a first timing standard, 
collecting sync timing information for the received information, and modifying the collected sync timing information. 
The modified sync timing information is then transmitted with aggregate information and low bandwidth information. 
Next, the sync timing information, the aggregate information and the low bandwidth information are received. Audio is 

10 then generated from the received aggregate information using at least the low bandwidth information. The audio is 
output as an audio stream ; the first timing standard is reconstructed, and video is also output. 

[001 3] In one embodiment, the method may further comprise decreasing the duration of a blanking interval associated 
with the first timing standard. The low bandwidth may be redundantly transmitted, and may comprise audio length 
information or other non-timing, for example. 
15 [0014] Additional features of the present invention, as well as details of an illustrated embodiment thereof, will be 
more fully understood from the following description and drawings, wherein like numerals refer to like parts. 

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS 

20 [0015] 

Fig. 1 illustrates a block diagram of an exemplary digital display link system; 

Fig. 2 is a stylized example of a digital video frame that illustrates timing information; 

25 

Fig 3 illustrates a block diagram of a digital display link system with increased digital data capacity in accordance 
with one embodiment of the present invention; 

Fig. 4A depicts a transmitter system architecture for increasing digital data capacity in.accordance with one em- 
30 bodiment of the present invention; 

Fig. 4B depicts a receiver system architecture for increasing digital data capacity in accordance with one embod- 
iment of the present invention; 

35 Fig. 5 represents a modified or reformatted frame definition generated by the DVI transmitter frame re-formatter 

of Fig. 4; 

Fig. 6 illustrates a timing diagram of the first line in the modified frame definition of Fig. 5; 

40 Fig. 7 illustrates one embodiment of a frame definition packet format in accordance with the present invention; 

Fig. 8 illustrates a timing diagram of all lines but the first in the modified frame definition of Fig. 5; 

Figs. 9A and 9B illustrate a flow diagram of one method of increasing digital data capacity in accordance with one 
45 embodiment of the present invention; 

Figs. 10A and 10B provide an overview of an alternate method of increasing digital data capacity in accordance 
with one embodiment of the present invention similar to that illustrated in Figs. 9A and 9B, which utilizes redundant 
transmission of low bandwidth information; 

50 

Fig. 1 1 illustrates a block diagram of one embodiment of a Fl FO buffer circuit used for assembling the audio streams 
into a single stream for transmission in the horizontal blanking periods in accordance with one embodiment of the 
present invention; 

55 Fig. 12 illustrates a block diagram of one embodiment of a FIFO buffer circuit used for assembling the auxiliary 

streams into a single stream for transmission in the vertical blanking period in accordance with one embodiment 
of the present invention; 
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Fig 1 3 illustrates a block diagram of one embodiment of a data stream multiplexer for multiplexing the digital audic, 
alfxiJarJ distal data and digital video streams into a single digital stream for transmission across a DVI 1.0 ,n 
accordance with one embodiment of the present invention; 

Fir, ^A illustrates a block diagram of a data stream demultiplexer for demultiplexing the single digital stream into 
the digtol SEVuSIS Sa. data and digita. video streams in accordance with one embodiment of the present 



invention; 



Fia 1 5 illustrates a block diagram of a FIFO buffer circuit used for separating the single composite auxiliary data 
channel imo ^s constituent data streams in accordance with one embodiment of the present invention; and 

Fia 16 illustrates a block diagram of a FIFO buffer circuit used for separating the single composite audio data 
channel intc TconsLent data streams in accordance with one embodiment of the present mvention. 

15 DETAILED DESCRIPTION OF THE INVENTION 

SI 205 is also comprised o, ,h,sa a—: a M. „„,« 2,3, addr.ssab.a vidao 2,5, and a 
« K^tt^m K^rHAr 9?q Like HSYNC VSYNC can be either positive or negative. 

0022 F-me-'e stack* J vertically, so that the entire video stream is a continuum of vertically stacked „nes, A.I 
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specifies unformatted audio data, SPDIF, or DVD audio. It is anticipated that other audio formats will be developed, 
and are contemplated by the present invention. For any input standard that encodes a clock onto the data (i.e. SPDIF 
uses bi-phase mark encoding for much of the transmitted data), an audio input interface layer is utilized to remove the 
clock component to conserve link bandwidth. This encoding is re-applied by the receiver to reproduce the data format 

5 provided to the transmitter system. 

[0027] The HDCP engine 304 encrypts or transforms the information according to an HDCP standard 1 .0. In one 
embodiment, the HDCP engine 304 receives the transmitted information and encrypts it. In another embodiment, the 
HDCP engine 304 can be omitted. A DVI transmitter 306 communicates with the HDCP engine 304. The DVI transmitter 
306 transmits the video, audio and auxiliary data stream (with optional encryption) to the DVI receiver 31 0 via a digital 

10 video communications or DVI link 308. While the HDCP engine 304 and DVI transmitter 306 are illustrated as separate 
devices, it should be appreciated that a DVI transmitter with an integrated HDCP encryption engine is also contem- 
plated. 

[0028] The DVI receiver 310 communicates the aggregate information, with the modified sync timing., to a HDCP 
decryption engine or device 312, where the information is decrypted or reformed (i.e., transformed) according to an 

15 HDCP 1 .0 standard. In one embodiment, the multiplexed unencrypted data is communicated to a DVI CE receiver 31 4, 
where it is demultiplexed and output as independent video, audio and auxiliary data streams. The timing input to the 
CE transmitter 302 is reproduced, and the video stream is also output. While the HDCP decryption engine 312 and 
DVI receiver 314 are illustrated as separate devices, it should be appreciated that a DVI receiver with an integrated 
HDCP encryption engine is also contemplated. 

20 [0029] Fig. 4A depicts a transmitter system architecture for increasing digital data capacity in accordance with one 
embodiment of the present invention. Transmitter system 400 is a more detailed depiction, for example, of the left side 
of Fig. 3 (i.e., of the DVI CE transmitter 302, the HDCP engine 304, and the DVI transmitter 306). 
[0030] Transmitter system 400 comprises a DVI transmitter frame reformatter 401 (corresponding to the DVI CE 
transmitter 302 of Fig. 3), an optional HDCP encryption engine 403 (corresponding to HDCP engine 304 of Fig. 3) and 

25 a DVI 1 .0 Transmitter 405 (corresponding to DVI transmitter 306 of Fig. 3). The transmitter system 400 receives sep- 
arate inputs of video as well as audio and/ or auxiliary data, and formats the data in such a way that all inputs to the 
DVI transmitter 405 are compliant with the requirements of the DVI 1 .0 specification (which does not support separate 
inputs of audio or auxiliary data). The addition of audio and/or auxiliary data is achieved without changing the overall 
pixel clock rate of the DVI 1 .0 standard (or other current standard). 

30 [0031] Specifically, the transmitter system 400 receives as inputs a single stream of video data over a video channel, 
from 0 to 8 streams, for example, of audio data over one or more audio channels, and from 0 to 4 streams, for example, 
of auxiliary data over one or more auxiliary channels. The standard video frame (i.e., video timing standard) that serves 
as an input to the transmitter system 400 may be any current standard compatible with currently available displays. 
As discussed above, one representation of a standard video frame is diagrammed in Fig. 2. The names for various 

35 parameters used in Fig. 2 are intended to be the same as used by the VESA timing standards. Fig. 2 is organized such 
that the HSYNC signal occurs on the left side of the diagram and the VSYNC signal occurs at the top. This is done to 
support HDCP encryption. 

[0032] Referring again to Fig. 4A, the audio input to the transmitter system 400, i.e., data transmitted over the audio 
channel(s), may be, as mentioned above, unformatted audio data, SPDIF, or DVD audio, for example. Again, it is 
40 anticipated that other audio formats will be developed, and are contemplated by the present invention. Also as men- 
tioned above, for any input standard that encodes a clock onto the data (e.g., SPDIF uses bi-phase mark encoding for 
much of the transmitted data), the audio input interface layer 407 may remove the clock component to conserve link 
bandwidth. This encoding is then re-applied by the receiver (Fig. 4B). 

[0033] Finally, auxiliary data input to the transmitter system 400, i.e., data transmitted over the auxiliary channel(s), 
45 may be, for example, closed captioning data, or other data that provides information to a user. 

[0034] The DVI transmitter frame re-formatter 401 accepts as inputs, the video channel, the audio channel(s) and 
the auxiliary channel(s), and combines the data into an aggregate data or frame analogous to a current video timing 
standard (e.g. : analogous to DVI 1 .0). This aggregate frame is then output to the DVI transmitter 405, which commu- 
nicates it, typically over a digital video communications link. 
so [0035] The communicated aggregate frame is then received by a receiver system such as shown in Fig. 4B. Receiver 
system 450 is a more detailed depiction, for example, of the right side of Fig. 3 (i.e., of the DVI receiver 310, the HDCP 
decryption engine 312, and the DVI CE receiver 314). 

[0036] DVI receiver 451 receives the aggregate information and communicates it, with the modified sync timing, to 
an HDCP decryption engine 453, where the information is decrypted or reformed (i.e., transformed) according to the 
55 HDCP 1 .0 standard. In one embodiment, the multiplexed unencrypted data is communicated to a receiver frame refor- 
matter 455, which splits out the auxiliary, audio and video data and outputs independent video, audio and auxiliary 
data streams. The timing input to the transmitter frame reformatter 401 of Fig. 4A is also reproduced by the receiver 
frame reformatter 455. 
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,0037, ,» » oper«n o, to. rrysr.rrrs 400 »od 450 C Rjr^nd f^,^, iZ^d" 

audio and auxiliary data. d back ch (of Fig . 2 , for example) 

carried by these lines is defined in the 'VSYNC h "® o f ^„ andaudtodate carried on each line is variable. 

pixels output from the DVI receiver. „„„„ m ittoH ar^ nreceded with a blanking period. This 

[0042] In one embodiment of the present invent.on, all lines tra h nS fl 7^;;.^; u ,33 ™ 8 . pixel cloc k back porch, 
Lnking period consists of 5 elements: an 8-pi *on J^^J^TJ., the descriptor back 
a 32-pixel clock audio length descnptor and a descnptor back ■ P^h^o t Qther ^ |r ^ 

porch's 72 pixel clocks long. This satisfies the J^^^"^ or 72 pixel clock cycles in duration, 
frame the descriptor back porch may be one of 8, 16, 24, 

resulting in a blanking period that ranges from 64 to 128 clocks ilon* c£ 0 p era tion), a ct!1 

[0043] To ensure accurate <^££^^%^£%„ Figs. 6 and 8, described below), 
signal is asserted at the same time the VSYNC and/or hmno syn p reproduce d by the receiver, has the 

The HSYNC pu.se can be either positive or negate W^^^ P ,^^Lr positive or negative going, 
same polarity as the transmitted HSYNC pulse. Sflita* ^^^S^L transmitted VSYNC pulse. 
The VSYNC pulse, as reproduced by the receiver, Tposme going pulse may indicate, for 

[0044] The CTL1 signal may have other a P~^ r '"^^^^ng pu.se may indicate, for example, 
example, that no error correction ,s being used for jhe auc ,o ^. ^^ ^ to accept the audio error 

^^^^ 

period, in otherwords, non-timing, .ow-bandw,dth bandwidth. The audio length de- 

dant. The descriptor may be 8 bits in length, for example, tacn on y transmitted Qimultaneouslv: one on the 
for a total descriptor length of 32 bits. Three copies of ^jTlT^t^th. receiver can detente, based 

epresents a modified VSYNC pulse. The line begins , with a blanking ^^^^^ time for bla nking 
inFig. 6, the blanking period 601 occurs """[^ field 605 <HdrPx,r7: 

period 601 is 128 pixel clock cycles long. Following the blanking ipenoc. b ' All parameters needed 

0]). This field is transmitted over the eight pixel clock cycles follow ng the ££"£ngp e P 605 . 

to reconstruct a standard video frame at the receiver are def ned n the da tepacteunr ^ 
[0048] One possible location of the various ^^^^J^^^^^ definition packet 700 of 
[01 is the first 24 bit pixel transmitted after the blanking period 601 of Fig. 6 enas. 
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Fig. 7 is 8 pixel clock cycles long and contains all information necessary to: (1) define the VSYNC pulse to be regen- 
erated at the receiver, (2) define the HSYNC pulse to be regenerated at the receiver, and (3) temporally align the audio, 
video, and auxiliary data. All signals shown in Fig. 7 are defined, according to one embodiment, in Table 1 below. 



5 




Table 1 




Signal 


Description 


10 


HFrntPrch[8:0] 


Horizontal Sync Front Porch. Specifies the number of pixel clock cycles into the blanking period 
that the horizontal sync will start. Used to generate the HSYNC pulse at the receiver. On the 
transmitter, this value is set via the configuration registers or via automatic detection. ; 




HsyncWdth[9:0] 


Horizontal Sync Pulse Width. Specifies the duration of the horizontal sync in pixels. Used to 
generate the HSYNC pulse at the receiver. On the transmitter, this value is set via the 
configuration registers or via automatic detection. 


15 


HBckPrch[10:0] 


Horizontal Sync Back Porch. Specifies the number of pixel clock cycles following the horizontal 
sync pulse that the blanking period will end. Used to generate the HSYNC at the receiver. On 
the transmitter, this value is set via the configuration registers or via automatic detection. 


20 


VFrntPrch[6:0] 


Vertical Sync Front Porch. Specifies the number of lines into the vertical blanking period that the 
vertical sync will start. Used to generate the VSYNC pulse at the receiver. On the transmitter, 
this value is set via the configuration registers or via automatic detection. 




VsyncWdth[3:0] 


Vertical Sync Pulse Width. Specifies the duration of the vertical sync in lines. Used to generate 
the VoYlMU pulse at the receiver, un tne transmitter, inis vaiue is set via me conngurciuon 
registers or via automatic detection. 


25 


VBckPrch[8:0] 


Vertical oync tJack Horcn. opecines ine numuer ot lines Tonowing me veruceii £»yriL, puibt; uirii 
the blanking period will end. Used to generate the VSYNC at the receiver. On the transmitter, 
this value is set via the configuration registers or via automatic detection. 


30 


HactvPxls[15:0] 


The number of horizontal addressable pixels in the output screen . Note that this number includes 
the borders if left/right borders exist. 




VactvPxls[15:0] 


The number of vertical addressable lines in the output screen. Note that this number include the 
borders if top/bottom borders exist. 


35 


AudioFmt[7:0] 


This field is used to convey the audio format being transmitted 0->Raw, parallel 24 bit data 1 -^S/ 
PDIF 2->DVD Audio etc. 


AuxFmt[7:0] 


This field is used to convey the auxiliary format being transmitted. O^Raw, parallel 24 bit data 
1 —►closed captioning etc. 




SNVideo[4:0] 


This number is used to align the received video data with the corresponding audio and auxiliary 
data 


40 


SNAudio[4:0] 


This number is used to align the received audio data with the corresponding video and auxiliary 
data 




SNAux[4:0] 


This number is used to align the received auxiliary data with the corresponding audio and video 
data 



45 



[0049] The variables that define the frame metrics (HFrntPrcn, HsyncWidth, HBckPrch, VFrntPrcn : VsyncWidth, 
VBckPrch, HactvPxIs and VactvPxIs) generally do not change regularly. These values may therefore be observed over 
at least 2 frames to ensure that any changes are not the result of bit errors over the communications link. 
[0050] As mentioned above, Fig. 6 illustrates a timing diagram of the first line 501 in the modified frame definition of 

50 Fig. 5. Every other line of Fig. 5 takes the form shown in Fig. 8. In other words, Fig. 8 illustrates a timing diagram 800 
of these lines, and represents a modified HSYNC. There are generally three differences between the timing diagrams 
of Fig. 8 and Fig. 6. First, VSYNC does not transition during the modified blanking period in Fig. 8 (see generally 
reference numeral 801). Second, there is no frame definition packet in Fig 8. Finally, the back porch of the blanking 
period maybe either 48 or 112 pixel clocks long creating a blanking period 803 that is of 8, 16, 24, 32, 40, 48, 56, 64, 

55 or 72 pixel clocks long. This is different from the 128 pixel clock blanking period of the first line. This allows for more 
efficient usage of the total available bandwidth. 

[0051] The 48 pixel clock back porch, for example, is an optional mode that is not required. It is made available for 
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applications involving more than 2 channels of audio data as in 5. 1 or 7.1 . The transmit hardware queries the receiver 
via a DDC channel to ascertain if the receiver is capable of receiving shorter blanking periods. 
[0052] Figs. 9A and 9B provide an overview of one method of increasing digital data capacity in accordance with 
one embodiment of the present invention. In one example, the illustrated method may be used to increase the digital 
5 data capacity of a digital video communications link wherein the data on the link is encrypted according to the HDCP 
standard. 

[0053] The illustrated method 900 starts, transmitting information at a first timing standard as illustrated by block 
902. The transmitted information is received as illustrated by block 904, sync timing information about the received 
information is collected as illustrated by block 906 and the collected timing information is modified as illustrated by 

10 block 908. Audio and/or auxiliary data are multiplexed along with video data onto a video stream, forming aggregate 
information, and transmitted with the modified timing as illustrated by blocks 910 and 912 respectively. 
[0054] In addition to transmitting the aggregate information and modified timing information, non-timing, low band- 
width information is transmitted during the blanking periods as illustrated by block 91 2A. This low bandwidth information 
may be, for example, close captioning information, other auxiliary data information, or even audio. The aggregate 

15 information, with the modified sync timing, is received as illustrated by block 914 and demultiplexed as illustrated by 
block 916. Demultiplexing the aggregate information reconstructs or regenerates the audio and auxiliary data. The 
audio and auxiliary data is output as an audio and auxiliary stream as illustrated by block 918. The first timing standard 
is reconstructed and a video stream is output at the first timing standard as illustrated by blocks 920 and 922, respec- 
tively. 

20 [0055] Figs. 1 0A and 1 0B provide an overview of an alternate method of increasing digital data capacity in accordance 
with one embodiment of the present invention similar to that illustrated in Figs. 9A and 9B. Again, the illustrated method 
may be used to increase the digital data capacity of a digital video communications link wherein the data on the link 
is encrypted according to the HDCP standard. 

[0056] Illustrated method 1000 proceeds like the method 900 of Figs. 9A and 9B, except that block 1012A of Fig. 

25 10A is different than block 91 2A of Fig 9A, and new block 1014B is added in Fig. 10B. Specifically, in block 1012A of 
Fig. 10A, the low bandwidth information is transmitted redundantly. This is done, for example, in cases where the low 
bandwidth information being sent is sensitive to channel errors. For example, in an embodiment where audio length 
information is transmitted during the blanking period, redundancy may be used (as discussed above). Once the audio 
length information is received (block 1014A) and the correct audio length data determined (block 1014B), the audio 

30 length information is used at block 1016 to pull the audio data from the aggregate information. 

[0057] Fig. 11 is a block diagram of one embodiment of a FIFO buffer circuit 1100 used in one embodiment for 
assembling the audio streams into a single stream for transmission in the horizontal blanking periods. In this embod- 
iment, four channels of 24 bit digital audio date are assembled into a single stream. Four audio inputs, Audiolnl 11 02, 
Audioln2 1104, Audioln3 1106, and Audioln4 1108 are illustrated as inputs to FIFO circuits 1110, 1112, 1114 and 1116, 

35 respectively. Each of the FIFO circuits has two outputs, FIFOI 1120 and FIFOIJHF 1122. For example, FIFO Circuit 
1110 has FIFOI and FIF01 JHF outputs 1120 and 1122, while FIFO circuit 1116 has FIF04 and FIF04_HF outputs 
1120 and 1122 as illustrated. Each of the FIFO outputs 1120 are communicated to a multiplexer 1124 while each of 
the FIFOJHF outputs 1122 are communicated to a control 1126 communicating with the FIFO circuit 1128 and multi- 
plexer 1124. FIFO circuit 1128 receives an output of the multiplexer 1124 as its input. Audio FIFO Read 1132 is com- 

40 municated to the FIFO Circuit 1 1 28 and Auxiliary Out 1 130 is outputto the Data Stream Multiplexer illustrated in Fig. 1 3. 
[0058] In this embodiment, each audio link supports data at rates of at least 3.1 Mbps. It is contemplated this rate 
may be exceeded, however the throughput of all combined channels generally does not exceed the maximum available 
audio bandwidth. 

[0059] Fig. 12 illustrates a block diagram of one embodiment of a FIFO buffer circuit 1200 used to assemble the 
45 auxiliary streams into a single stream for transmission in the vertical blanking period. In one embodiment, two channels 
of 24 bit auxiliary data Auxlnl 1202 and Auxln2 1204 are illustrated being assembled into a single stream. The FIFO 
buffer circuit 1 200 includes two FIFO circuits 1 206 and 1 208 having Auxlnl 1 202 and Auxln2 1 204 as inputs. Of course, 
any number of audio or auxiliary channels may be used. 

[0060] Each of the FIFO circuits has two outputs, FIFO 1210 and FIFOJHF 1212. For example, FIFO Circuit 1206 
so has a FIF03 and FIF03_HF outputs 1 21 0 and 1 212, while Fl FO circuit 1 208 has a FIF04 and FIF04JHF outputs 1 21 0 
and 1212 as illustrated. Each of the FIFO outputs 1210 are communicated to a multiplexer 1214 while each of the 
FIFO_HF outputs 1212 are communicated to a control 1216 communicating with a third FIFO circuit 1218. FIFO circuit 
1218 receives an output from the multiplexer 121 4 as an input. Auxiliary FIFO Read 1220 is communicated to the FIFO 
Circuit 121 8 and Auxiliary Out 1222 is output to the Data Stream Multiplexer illustrated in Fig. 13. It should be appre- 
55 ciated that, in one embodiment, the throughput of the combined auxiliary channels does not exceed the maximum 
available auxiliary bandwidth. In addition, the auxiliary bandwidth may be defined as the traditional vsync blanking 
period less the hsync portion of this blanking period. 

[0061] Fig. 13 illustrates a block diagram of one embodiment of a data stream multiplexer, generally designated 
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1300, for multiplexing the digital audio, auxiliary digital data and digital video streams into a single digital stream for 
transmission across a DVI link. In this embodiment, the multiplexer multiplexes a video input 1302, DE 1304, ctl[1] 
1306. ctl[2] 1308 and ctl[3] 1310. In addition, the audio out 1130 and auxiliary out 1222 are input and the Audio FIFO 
Read 1132 and Auxiliary FIFO Read 1220 are communicated to the FIFO buffer circuits 1100 and 1200 respectively 
5 as illustrated. The Data Stream Multiplexer 1300 outputs data 1311, DVI_DE 131 2 and DVI ctl 131 4 to a DVI compliant 
transmitter 1316. The DVI compliant transmitter in turn transmits this data to the receiving side illustrated in Figs 14, 
15 and 16. 

[0062] Fig. 14 illustrates a block diagram of one embodiment of a data stream demultiplexer, generally designated 
1400 for demultiplexing the single digital stream into the digital audio : auxiliary digital data and digital video streams. 

10 This device performs the inverse functions of the multiplexer illustrated in Fig. 1 3. 

[0063] A DVI compliant receiver 1416 receives or acquires the data transmitted by the DVI compliant transmitter 
1316. In this embodiment, the receiver 1416 outputs data 1410, DVIJDE 1412 and DVI ctl 1414 to the Data Stream 
Demultiplexer 1400. The Data Stream Demultiplexer 1400 demultiplexes or separates such data into video output 
1402, DE 1404, ctl[1] 1406, ctl[2] 1408 and ctl[3] 1410. In addition, the Data stream demultiplexer 1400 outputs Audio 

15 out 1430 and Auxiliary Out 1422. Audio FIFO Read 1432 and Auxiliary FIFO Read 1420 are communicated to and 
from the FIFO buffer circuits illustrated in Figs 15 and 15. It should be appreciated that, in one embodiment, Audio Out 
1430, Auxiliary Out 1422, Audio FIFO Read 1432 and Auxiliary FIFO Read 1420 are substantially similar to, if not the 
same as, Audio Out 1130. Auxiliary Out 1222, Audio FIFO Read 1132 and Auxiliary FIFO Read 1220 discussed pre- 
viously. 

20 [0064] Fig. 15 illustrates a block diagram of a FIFO buffer circuit, generally designated 1500, used for separating the 
single composite auxiliary data channel into its constituent data streams. In one embodiment, this circuit performs the 
inverse function of the circuit illustrated in Fig. 12. In the illustrated embodiment, Auxiliary Out 1422 is separated into 
two channels of 24 bit auxiliary data AuxOutl 1502 and AuxOut 1504. The FIFO buffer circuit 1500 includes a FIFO 
circuit 1518 that receives Auxiliary Out 1422 as an input and outputs Auxiliary FIFO Read 1420. 

25 [0065] The FIFO Circuit 1518 communicates with an inverse multiplexer 1514 and a control 1516 that in turn com- 
municates with the inverse multiplexer 1514. The control 151 6 communicates with two FIFO Circuits 1506 and 1504 
and a clock recovery device, outputting an AUXCIock signal 1542. Of course, several clock recovery PLL's may be 
used to support multiple auxiliary and audio data rates 

[0066] Each of the FIFO circuits 1506 and 1508 has two inputs, FIFO 1510 and FIFOJHF 1512, where FIFO 1510 
30 is communicated by the inverse multiplexer 1514 and FIFJHF is communicated by the control 1516. For example, 
FIFO Circuit 1506 has a FIF03 and FIF03_HF inputs 1510 and 1512, while FIFO circuit 1508 has a FIF04 and 
FIF04_HF inputs 1510 and 1512 as illustrated. Each of the FIFO circuits has one output, where FIFO circuit 1506 
outputs AuxOutl 1502 while FIFO Circuit 1508 outputs AuxOut 1504 as illustrated. 

[0067] Fig. 16 is a block diagram of a FIFO buffer circuit 1600 used for separating the single composite audio data 
35 channel into its constituent data streams. This in the inverse function of the system illustrated in Fig. 11. In the illustrated 
embodiment, AudioOut 1430 is separated into AudioOutl 1602, AudioOut2 1604, AudioOut3 1606 and AudioOut4 
1608. The FIFO buffer circuit 1 600 includes a FIFO circuit 1628 that receives AudioOut 1430 as an input and outputs 
Audio FIFO Read 1432. 

[0068] The FIFO Circuit 1628 communicates with a inverse multiplexer 1624 and a control 1626 which outputs a 
40 signal to an inverse multiplexer 1624. The control 1626 communicates with four FIFO Circuits 1610, 1612, 1614 and 
161 6 and PLL 1 640 outputting an AudioClock signal 1 642. In addition, the FIFO circuit communicates with the inverse 
multiplexer 1 624. 

[0069] As illustrated, control 1626 communicates with the FIFO circuits using FIFO_HF 1622 signals as illustrated. 
In addition, the inverse multiplexer 1624 communicates with each of the FIFO circuits using FIFO signals 1620, and 
45 the FIFO circuits communicate with each other as illustrated. 

[0070] Many modifications and variations of the present invention are possible in light of the above teachings. Thus, 
it is to be understood that, within the scope of the appended claims, the invention may be practiced otherwise than as 
described hereinabove. 

50 

Claims 

1 . A processing system for increasing the digital data capacity of a digital video communications link, comprising: 

55 at least one assembly device adapted to assemble a plurality of digital data streams into a single digital data 

stream; 

a multiplexer adapted to multiplex the single digital data stream with a line of video data forming an aggregate 
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digital data stream; and 



at least one transmitter adapted to transmit said aggregate digital data stream and I low ^^^S^ 
said low bandwidth information being transmitted during blanking periods associated with the aggregate digita. 



data stream 



2. The system of claim 1 wherein said transmitter redundantly transmits said low bandwidth information. 

3. The system of claim 1 wherein said digital data stream comprises a digital audio data stream. 

4. The system of claim 1 where said at least one assembly device comprises a Fl FO circuit. 

5. The system of claim 1 further comprising a receiver adapted to receive said aggregate digita. data stream and said 
low bandwidth information. 

6. The system of claim 1 further comprising a de-multip.exer adapted to de-multiplex said aggregate digital data 
stream. 

7. The system of claim 1 wherein said low bandwidth information comprises non-timing information. 

8. The system of claim 7 wherein the digita. data stream comprises a digital audio data stream, and the low bandwidth 
information comprises audio length information. 

9. A system for increasing a digital data capacity of a digital video communications link, said system comprising. 

means for accepting video data and audio data and combining said data into aggregate data that is compatible 
with a predetermined video timing standard; and 

means for transmitting said aggregate data and low bandwidth information. 

10. The system of Cairn 9 wherein said low bandwidth information is transmitted during at least one b.anking period 
of said aggregate data. 

11. The system of claim 9 wherein said low bandwidth information comprises non-timing information. 

12. The system of claim 11 wherein the low bandwidth information comprises audio length information. 

13. The system of Cairn 9 further comprising means for splitting said aggregate data into said video data and said 
audio data. 

14. The system of Cairn 12 further comprising means for splitting said aggregate data into said video data and said 
audio data using said low bandwidth information. 

15. The system of Cairn 9 wherein said means for transmitting said low bandwidth information comprises means for 
redundantly transmitting said low bandwidth information. 

16. A method for increasing the digital data capacity of a digital video communications link, comprising: 

decreasing the duration of a blanking interval associated with a line of video data to a duration .ess than 
industry standard blanking intervals; 

combining a digital data stream with a line of video data; and 
transmitting said digital data stream and low bandwidth information. 

17. The method of claim 16 wherein the digital data stream comprises an audio data stream. 

18. The method of claim 17 wherein said low bandwidth information comprises audio length information. 
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19. The method of claim 16 wherein said low bandwidth information comprises non-timing information. 

20. The method of claim 16 wherein said transmitting occurs using bandwidth freed by said decreasing. 

21. The method of claim 16, including redundantly transmitting said low bandwidth information. 

22. A method for increasing the digital data capacity of a digital video communications link, said method comprising 
the steps of: 

receiving information transmitted at a first timing standard; 
collecting sync timing information for said received information; 
modifying said collected sync timing information; 

transmitting said modified sync timing information with aggregate information and low bandwidth information; 
receiving said sync timing information, said aggregate information and said low bandwidth information; 
generating audio from said received aggregate information using at least said low bandwidth information; 
outputting said audio as an audio stream; 
reconstructing said first timing standard; and 
outputting a video stream. 

23. The method of claim 22, including redundantly transmitting said low bandwidth information. 

24. The method of claim 22, including transmitting said aggregate information and modified sync timing at a first timing 
standard. 

25. The method of claim 23 wherein said low bandwidth information comprises audio length information. 

26. The method of claim 22 further comprising decreasing the duration of a blanking interval associated with said first 
timing standard. 

27. The method of claim 22 wherein said low bandwidth information comprises non-timing information. 
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